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SUMMARY 


The  procedure  developed  by  two  of  the  authors  (Foiaj  and 
Fulkerson)  for  solving  transportation  problems  Is  a  natural 
extension  of  the  Kuhn— Egervary  method  for  solving  assignn.ent 
px^blems .  In  the  present  paper  the  procedure  Is  excer;ded 
further  to  the  general  linear  programming  case. 
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A  PR1I!AI/-DUAL  ALGORITHM 


lu’  IKTOODUCTION 

Kuhn,  baolng  his  investigation  on  the  work  oT  Eg?rv£ry, 
has  developed  a  special  routine  Tor  solving  aoeigntnent  problems 
fio] .  Paul  IX#yer  has  proposed  a  similar  type  of  approach  for 
the  more  general  transportation  problem  [?] .  Also,  along  the 

a 

same  lines,  two  of  the  present  ^thora  [8]  have  developed,  in 

0 

connection  with  maxima l-flovrspi^blemR  in  networks,  a  special 
algorithm  that  has  been  extended  to  Hitchcock*-Koopmana  trans¬ 
portation  problems  [3*9]  •  ,/ 

Experiments  indicate  that  this  technique  is  very  efficient. 
Our  purpose  la  to  generalize  the  process  to  solve  the  general 
linear  programming  problem.  As  stated  here,  it  becomes  a  special 
variant  of  the  simplex  process  [4, 2, 6, 3]*  that  promises  to  reduce 
the  number  of  iterations  by  doing  away  wlt.h  the  two— phase  proceos* 
(In  Phase  I  a  basic  feasible  solution  is  determined ;  this  is 
needed  to  initiate  Phase  II,  in  which  an  optimal  basic  feasible 
solution  is  obtained.) 

Any  feasible  solution  to  the  dual  system  may  be  used  to 
initiate  the  proposed  method.  Associated  with  the  dual  solution 
is  a  "restricted"  primal  problem  that  requires  optimization. 

When  the  solution  of  the  resti’icted  primal  problem  has  been 
accomplished,  an  Improved  solution  to  the  dual  ayaterr  can  be 
obtained.  This  in  turn  gives  rise  to  a  now  restricted  problem 
to  be  optimized.  After  i  finite  number  of  Improvements  of  the 
dual,  an  optimal  solution  is  obtained  for  both  the  prl:r.al  and 
dual  oyatems . 
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Whnt  Olutlngulshea  the  tranaportat ton  case  Tfom  the  more 
general  caae  la  that  for  the  for-ner  the  opt  lr.lz?<tlon  of  the 
primal  auxiliary  problem  can  be  ac^’otfipl Ished  without  the  uoe 
of  the  simplex  proceao,  whereas  the  gencrallzatlot^  appears  to 
require  thla  process.  Thus  It  might  aeem  that  wo  are  proposing 
a  new  algorithm  to  replace  the  ordinary  simplex  algorithm  when, 
in  fact,  the  simplex  algorithm  itself  is  inbeaded  within  the 
proposed  algorithm. 

Actually,  the  entire  process,  as  we  view  It,  may  be  con¬ 
sidered  to  be  a  way  of  starting  with  an  Infeasible  basic  solu¬ 
tion  to  a  linear  prograirjning  problem  and  using  a  feasible  .solu¬ 
tion  to  the  dual  If  available  (otherwise  a  solution  of  the 
modified  dual  discussed  below)  to  decrease  the  infeaslblllty  of 
the  primal  In  ouch  a  manner  that  when  a  feasible  basic  solution 
Is  obtained.  It  will  be  optimal. 


2.  THK  PRIMAL  AND  DUAL  PROBLEMS 

We  take  the  primal  problem  in  the  following  form:  i)etermine 
values  of  x^,...,x^,  z  which  minimize  z  subject  to 

f 

(1)  OjX,  +  CgXj  +  ...  .  o„x„  -  ?, 

(2)  ®11*1  +  *12*2  *'  •••  *  *ln*n  "  '’l  f**!  ji  • 


a  x. 
ml  1 


®m2*2 


*^n.n^n 


m  b 


m 


(3) 


Xj  ^0 


.  • .  ,n). 
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where  a^j,  Cj,  arc  given  constants .  Ihere  lb  no  Iosh  of 
generality  in  aebuuiiing  >  0  since  the  signs  or  all  ter/rj 

in  an  equation  can  be  changed  if  necessary. 

The  dual  problem  is  to  find  ...  z  which  maxi¬ 

mize  z  subject  to 


(M 

(0) 


h’l 

+ 

b^iTg  > 

.  •  •  b_i< 

m  m 

■  z 

ii"i 

®21^2 

• .  •  ^  a_  • 

ml  tr. 

u 

VI 

“ln*l  *  ®2n'2  ^ 


+  a^^TT  < 

mn  in  —  n 


It  la  easy  to  show  that  always  t  <  z  for  any  solutior.i.  to  (1), 
(2),  (3)  and  to  (4),  (^).  The  fundamental  duality  theorem  states 
that  if  solutions  to  the  primal  exist  and  z  has  a  finite  lower 
bound,  then  optimal  solutions  for  both  primal  and  dual  exist; 
moreover,  any  optimal  solutions  for  the  primal  and  dual  systems 
have  the  property  that  z  »  z.  Our  purpose  Is  to  construct  a 
pair  of  such  solutions. 

We  shall  need  a  feasible  solution  to  the  dur l  to  start  the' 
algorithm.  In^many  problemo,  such  a  solution  Is  readily  avail¬ 
able.  Por  example,  if  all  Cj  >  0  then  obviously- 0  sati.sfy 
(5)*  In  general,  however,  a  dual  solution  is  not  avrtllable.  To 
get  around  thir. ,  we  use  a  device  due  to  ^leale  [l]  and  others, 
and  append  to  system  (2)  the  relation 


(C) 


» 


Xq  +  Xj  + 


^  *n  •  ^0 


V 


where  Is  unspecified  but  is  thought  of  as  being  arbitrarily 

large.  (More  precisely,  for  each  cycl#  k  of  the  algorithm  a 

k  k 

value  bQ  can  be  specified  such  that  any  b^  ^ 

there  will  be  only  a  finite  number  of  cycles,  we  may  take 

b^  >  max  Oq.) 

<nie  problem  (1),  (2),  (3)*  i6)  will  be  called  the  modified 

i 

primal .  ^Hie  modified  dual  corresponding  to  it  ia  the  problem 
of  determining  ^  which  maximize  jr  subject  to 


(7)  Vo  +  “I'l  +  •••  ♦  ‘>m  ’^m  •  X  « 

(8)  »0  <  0  , 

*0  +  •••  +  *101%  ^  “l  ' 


0  in  1  mn  m  n 

Notice  that  a  feasible  solution  la  now  readily  available; 
indeed,  the  aet  of  values  Tq  «  min  (0,c^ , . . .yC^),  «  0  for  1  >  0, 

solves  (8). 

3.  THE  EXTENDED  PRIMAL  PROBLEM 

We  next  consider  an  extended  primal  problem  with  nonnegative 
err*or  (artificial)  variables  where  the  objective 

(as  in  Phase  I  of  the  simplex  process)  is  to  minimize  the  sum 
of  the  errors.  Thus  we  afe  to  detemlne  values  of  x^.x,  , . . . ,x_, 

'*^0' ^*1 ' ' '  * ^  which  minimize  w  subject  to 


•'V 
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(9) 


•¥  ^4  ♦  «  (  •  -f  f 


T  Cj  ^  .  .  .  ^  C  JJ,  -  W  , 


(10)  Xq  +  Xj  +  Xg  ♦  ...  ♦ 


*n  ^  'O 


®U*1  ■*■  *12*2  *•■  ••*  .'*'  ®ln*n 


♦  e, 


'1  » 


^1*1  ^  ‘.2*2  ^  Wn 


+  f 


m 


».« • 


(11)  Xj  iO,  >  0 


( J  *0  f  ...  I  n  j  1*0 ,  • • •  t  ^ ) • 


1 

Theorem  1 .  Any  solutions  to  (7),  (8)  and  to  (9),  (10),  (11) 

t  H 

with  the  propertlea  that  w  ■  0,  itq  ■  0,  and  Xj  •  0  if  the  J 
relation  of  (8)  ia  etrict  inequality,  are  optiraal  solutions  to 


the  original  primal  and  dual  problems. 

Proof.  Since  w  •  ^  ^  0  and  >  0,  we  have  all 


*  0.  Thu3,  because  •  0,  the  values  of  Xj,...,  x^;  Uj,..., 


(I 


satisfy  the  original  prinal  and  dual  constraints. 


th 


Multiplying  the  i  relation  of  (10)  by  and  summing  gives 

mm  m  in 

(^2)  Xj  r  ail'll  ^2  X^ia^'i  *n  .2!  ®lm^l  ”  X.^’l^i  * 

1-1  1-1  1*1  lai 


m 


By  assumption,  all  terms  in  (12)  corresponding  to  T  '*^1  '' 

*.w  i*' 

,th 


have  Xj  »  0;  hence,  for  all''J,  the  J  tex*m  is  the  same  as 
CjXj;  i.e.,  (12)  reduces  to 
n  m 

(15)  I-c.x  .  I  b.Tr. ,  or  z  *  z  , 

J-1  ^  ^  1*1  ^  ^ 

thus  establishing  that  x^,...,x^j  and  are  optimal  sol¬ 

utions  to  the  original  primal  and  dual. 
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».  THE  ALOORITHM 

Let  Vq,  ^*'y  numbers  oatisfying  (8). 

We  associate  with  this  selected  solution  of  the  modified  dual 


a  restricted  primal  problem^  which  Is  identical  with  the  ex¬ 
tended  primal  problem  (9),  (10)«  (11)  except  that  certain  Xj 
variables  are  "dropped**  from  the  equations.  To  be  more  precise, 
the  restricted  prima^  is  the  extended  primal  under  the 
conditions  that 


where 

(IM  .1 )  •*  7'o  » 

•  <*o  2!  “ij  ’i)  -  ®j 


From  (3)  it  will  be  noted  that  6^  <  0  for  all  J.  Thus  if  we  ' 
denote  the  set  of  Indices  for  which  6j  «  0  by  J,  the  restricted 

primal  is  obtained  from  the  extended  primal  by  dropping  all 

» 

variables  Xj  whose  indices  J  do  not  belong  to  J. 

The  restricted  problem  is  next  solved  using  the  revised  ^ 
simplex  method  [6] .  (Since  b^  is  unspecified,  the  values  of  the 
variables  Xj,  will  depend  linearly  on  bQ,  with  the  property 
that  for  all  b^  sufficiently  large,  the  solution  is  feasible.) 

For  example,  one  could  use  initial  set  of 

basic  variables  and  minimize  w  under  the  assumption  (I'O*  (On 
succeeding  restricted  primal  problems,  the  prior  minimal  solution 
may  be  taken  as  a  starting  solution,  as  we  shall  see.)  Tne  re¬ 
vised  simplex  algorithm  provides,  at  the  minimum  of  the  restricted 


probitm,  optimal  aolutlona  to  tho  rottricttd  proMeiri,  and 

to  Ita  dual,  such  that 

(15)  -  1  If  >  0,  <Tj  ^  1  If  -  0, 

-“j  •  *^0  ♦  X  ‘ij  <^1  “  o  ^  *J>  0' 

1-1 

(Notlc#  that  /Oj  la  dsfinsd  for  all  j  «  0, ...,n.) 

It  follows  that  tha  valuaa 


(16)  irj  •  ^  (l-O, 

aatitfy  tht  inodiflod  dual  aystom  (6)  for  soma  range  of  values 
0  <  0  <  Oq*  ***  this,  danota  tha  naw  valuaa  of  6^  by  Sj, 
so  that 


(17)  6j  -  6j  +  . 


.  Thus,  for  JiJ,  Sj  <  0 
for  any  9^0.  For  J/J,  8^  <  0;  hanoe  <  0  for  0  <  6  <  6^, 

whara 


Now  for  all  ^  S  9 


(18) 


min 

0>® 


or  9q  •  GO 


according  as  thara  ara  or  ara  not  any  Pj  >  0. 

Denoting  the  new  value  of  ^  by  ^  ,  «re  have,  from  (7)  anJ 

(16). 

m  SI  — 

(19)  z  "  £  tjTrJ  -  2  *>1(^1  ♦  -  z  ♦  e  2  hjOj  . 

l.«0  1*0  1«C 


v<«»n8 


th 


Now  by  multiplying  the  1  equation  oi*  (10)  by  duranlng  and 
noting  (1^),  we  get 


IB 

r- 


n 


r* 


ni 


1  1  jzo  J  •>  1^0  ^  ^ 


1*0 


1»0  ' 


hence  by  (i5),  (19)  becomes 

in  __ 

(?0)  y'  «  y  d  ^  o  y  4-  0  w  . 


We  may  therefore  state  the  following  result. 

Thoorem  2 .  An  optimal  solution  to  the  restricted  primal 
with  w  >  0  provides  n  new  feaalble  aolution  to  tnc  modified 
dual  with  a  strict  increase  In  the  maxifflizing  forji 

ir  w  >  0  and  all  A,  <  0  (so  that  Qq  •  oo  ) ,  then  w  la  minimal 
In  the  extended  primal  (9)»  (10),  (11).  Hence  in  this  case  there 
Is  no  aolution  to  the  original  primal  system,  ami  th.e  computation 
terminates . 

Assuming  that  w  >  0  and  some  >0,  we  repeat  the  procedure 
using  the  new  mo<llfled  dual  solution  «  7r^  -f  0^.,  and  its 
associated  restricted  primal.  Notice,  as  was  asserted  ear31er, 
that  we  may  take  the  prior  minimizing  solution  for  w  a.s  an  Ini¬ 
tial  solution  In  the  new  restricted  prlirtal,  since  those  t  for 

which  X,  >  0  have  both  0,  ■=  C  and  •*  0,  hence  0,  =  0. 

J  J  J  o 

Iticorem  ^ .  The  alo;orlthni  teniiinates  In  a  il.tlle  number  of 
steps  in  one  of  the  following  situations ; 

( ^ )  At  some  stage  »  oo  ;  hence  there  is  no  feas Ible  . 
sol ution  to  the  original  primal . 

nia )  At  some  stage,  w  «  0  and  ’’q  *  ^ J  then  x^ , .  . .  i 
''  j  »  •  •  • » ere  optimal  solutions  to  the  orljtlnal  vri'r.  il  tnd  eJuaj,. 
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(llb)  At  aome  stage  w  •  C  and  tt,  <  0;  then  the  orlalnal 


primal  form  z  has  no  loner  bound. 

0 

Proof.  We  auppoae  that  degeneracy  Is  avoided  In  each 
restricted  primal  by  using,  if  necessary,  a  perturbation  of 
the  b.  .  This  means  that  when  we  minimize  w,  the  set  of  x.  >0 

^  ii 

and  >  0  constitutes  a  basic  feasible  solution,  li'  ^^*00 

at  some  stage,  the  computation  ends  (as  we  have  seen)  wltn  the 

conclusion  that  no  feasible  solution  to  the  primal  exi&to.  If 

not,  then  at  each  stage  there  is  a  >0.  It  f cl Iowa  that  x. 

may  be  introduced  in  place  of  one  of  the  basic  variablea,  and 

the  ncndegeneracy  assumption  a^eans  that  w  will  be  strictly 

decreased.  Hence  the  solution  of  each  new  restricted  prlnal 

rcoulte  in  one  or  more  new  basic  solutlomto  the  extended  primal, 

each  with  a  decrease  in  w.  Thus  no  basis  carj  be  repeated  and 

the' process  must  terminate  in  a  finite  number  of  steps  with  a 

basic  solution  for  which  w  «  0. 

If  Tq  •  0  when  termination  occurs,  then  (see  Theorem  l) 

X.  are  optimal  for  the  original  prl.n&l  and 

i  r«  1  in 

dual.  •  If,  on  the  other  hand,  ttq  <  0,  then,  since  y  »  z,  wo 
see  from  (?)  that  there  Is  no  lower  bound  for  z  as  b^~>4-0D  . 

NUMEPICAL  EXAMPLES 

The  following  examples  correspond  to  the  oa'.ea  of 
3.  All  variables  are  nonnegative. 

Example  I.  Consider  the  equations 


-x^  +  Xj  - 


X  -  X3 


-  Xj,  .  1  , 


"  z , 


Figure  1 

Oeoaietrlcal  Picture  for  Example  1 


To  start  out,  take  »  -1,  ^  Hp  »  0.  TTien  &q  « 

’  6^  "  -1,  6j^  »  -1  .  The  solution  of  the  cor- 
rejpondlng  restricted  prisnal  is  X|  *  ^0  *  ^0 

with  raultlplleri-  6"^  •  I ,  •  0,  Thus  -  1,  ■  0, 

-  2,  »  0,  p,  *1,  ar.j  consequently  «  */«  •  Hence 

C  >  M  U 


‘I 


•V 


% 

• 


<•- 
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Tq  -  -Vfi*  ■  */*»  ^2  •  *  "Vt*  6|  •  0,  6^  «  0,  6^  •  -1, 

64  •  -*/••  Using  the  previous  minimal  solution  -  1 ,  0  "  • 

>  2  as  a  starting  point  and  minimizing  w  lor  the  new  restricted 

primal  gives  the  basic  solution  -  (bQ-*-l)/2,  -  (bQ--l)/2, 

*  «  «  «  « 

j  *  2,  with  multipliers  •  0,  0^  «  l ,  6’^  •  1 .  Then  i'q  ••  0, 

•  0,  /Jg  •  0,  ■  — 1#  •  —I*  and  co  »  Since  all  ^  <  0, 

w  «  2  Is  minimal  and  no  feasible  solution  exlrYn  to  Example  1. 

ExtirQlcs  11a, ‘lib «  For  the  next  two  examples,  we  record  In 
Tables  1  and  2  merely  the  extended  prljakl  in  detached -coerflclent 
form  together  with  a  record  of  successive  values  v,  b,  0,  <  and 
optimizing  X, ^  In  the  various  restricted  prinala.  The  problem 
may  be  plctvired  geometrically  aa  In  Figure  2,  where  Ila  and  lib 

V 

denote  the  nonrtala  to  (the  o^lmlzlng  forms  in  the  direction  of 


decreasing  z. 


Figure  2 

Geometrical  Picture  for  Exarnples  Ila,  lib 


Table  1 

SOLUTION  OP  EXAMPLE  11a 


1  1  1 


^3 


0 


1-3  0  0  0 

t 

’  0  0 

1 

loo  0  0 


0  0  01  (1) 


..  ii 


Ittration  "(0)  of  Ilb  requires  at  least  two  c^clej  of  the  simplex 
algorithm  since  basic  variables  replaced  by 
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